An improved method for Multi-Scale Retinex with Color Restoration (MSRCR) algorithm was proposed, to remove the fog at the far prospect and solve gray hypothesis problem. First, original fog image was inverted. Then, MSRCR algorithm was used on it. The inverted image was to be inverted again and then was linearly superposed with the result which was processed by MSRCR algorithm directly .At the same time , the reflection component which was got during the process of the extraction was linearly superposed with the original luminance, and the mean and variance were calculated to decide the contrast stretching degree adaptively, finally, it was uniformly stretched to the display device.The experimental results show that the proposed algorithm can get a better effect of removing the fog. Evaluation values of the processed image, including standard difference, average brightness, information entropy, and squared gradient, are improved than the original algorithm. It is easy to implement and has important significance for real-time video to remove fog.